BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Regulation events by Ev. Decom. - Approx. Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] Regulation 338 ( 84) 174 ( 84) 24.85 48.28 32.81
[UT+DBCLS ] Regulation 338 ( 86) 198 ( 86) 25.44 43.43 32.09
[ UTurku ] Regulation 338 ( 87) 215 ( 87) 25.74 40.47 31.46
[JULIELab ] Regulation 338 ( 95) 314 ( 95) 28.11 30.25 29.14
[VIBGhent ] Regulation 338 ( 45) 144 ( 45) 13.31 31.25 18.67
[ UTokyo ] Regulation 338 ( 38) 84 ( 38) 11.24 45.24 18.01
[ UZurich ] Regulation 338 ( 40) 121 ( 40) 11.83 33.06 17.43
[ UNSW ] Regulation 338 ( 42) 161 ( 42) 12.43 26.09 16.83
[ Cam ] Regulation 338 ( 29) 77 ( 29) 8.58 37.66 13.98
[UAntwerp ] Regulation 338 ( 32) 122 ( 32) 9.47 26.23 13.91
[ NICTA ] Regulation 338 ( 47) 354 ( 47) 13.91 13.28 13.58
[ Team 24 ] Regulation 338 ( 23) 92 ( 23) 6.80 25.00 10.70
[ SCAI ] Regulation 338 ( 31) 280 ( 31) 9.17 11.07 10.03
[CNBMadrid] Regulation 338 ( 51) 771 ( 51) 15.09 6.61 9.20
[ UAveiro ] Regulation 338 ( 22) 165 ( 22) 6.51 13.33 8.75
[ UNIMAN ] Regulation 338 ( 15) 47 ( 15) 4.44 31.91 7.79
[CIPS-ASU ] Regulation 338 ( 29) 521 ( 29) 8.58 5.57 6.75
[ USzeged ] Regulation 338 ( 11) 65 ( 11) 3.25 16.92 5.46
[CCP-BTMG ] Regulation 338 ( 9) 19 ( 9) 2.66 47.37 5.04
[ UMich ] Regulation 338 ( 15) 260 ( 15) 4.44 5.77 5.02
[ PIKB ] Regulation 338 ( 8) 15 ( 8) 2.37 53.33 4.53
[ KoreaU ] Regulation 338 ( 2) 12 ( 2) 0.59 16.67 1.14
[ASU+HU+BU] Regulation 338 ( 1) 13 ( 1) 0.30 7.69 0.57
[ Team 09 ] Regulation 338 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Regulation 349 ( 87) 201 ( 87) 24.93 43.28 31.64
[UAntwerp ] Regulation 349 ( 32) 124 ( 32) 9.17 25.81 13.53
[ Team 24 ] Regulation 349 ( 25) 94 ( 25) 7.16 26.60 11.29
[CNBMadrid] Regulation 349 ( 55) 914 ( 55) 15.76 6.02 8.71
[CCP-BTMG ] Regulation 349 ( 9) 19 ( 9) 2.58 47.37 4.89
[ASU+HU+BU] Regulation 349 ( 1) 13 ( 1) 0.29 7.69 0.55
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------